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1. Introduction 

In most physical phenomena, changes in spatial or temporal structure occur over 
a wide range of scales, hnages are no exception: changes in light intensity reflect 
the many spatial scales at which visible surfaces are organized. It seems intuitive 
that a great deal of information can be gained by an analysis of tlie changes in 
a signal at different scales. For instance, graphs of one-dimensional functions are 
a very effective tool for describing complex systems. An important reason is that 
they allow direct visual access to important properties of the data, chiefly to their 
changes over different scales. 

The idea of scale is critical for a symbolic description of the significant changes 
in images or other types of signals. Changes must be detected at different levels 
of detail and over different extents. In general different physical processes may 
be associated with a characteristic behaviour across different scales. In an image, 
changes of intensity take place at many spatial scales depending on their physical 
origin. A multiscale analysis, tracing the behaviour of some feature of the signal 
across scales, can reveal precious information about the nature of the underlying 
physical process. In images, for instance, spatial coincidence at all scales of zero- 
crossings in the Laplacian of the intensity values filtered with a gaussian mask, 
signals a physical "edge", distinct from surface markings or shadows. Not only 
is it necessai7 to detect and describe changes in a signal at different scales, but 
in addition, much useful information can be obtained by combining descriptions 
across scales. 

The importance of this idea has been clearly realized in the field of vision. One 
of the main contributions of visual psychophysics in the last 10 years was indeed 
to show that visual information is processed in parallel by a number (perhaps a 
continuum) of spatial-frequency-tuned channels (Campbell & Robson, 1968). ITie 
bulk of the data demonstrates that the visual system analyses the image at different 
resolutions. Physiological experiments are consistent with the psychophysics. 'fhey 
suggest that in the visual pathway spatial filters of different size operate at the same 
location. Furthermore, psychophysics, physiology and anatomy all show that the 
spatial grain of analysis continuously changes from foveal to peripheral locations. 
Receptive and dendritic field sizes of both retinal and cortical neurons increases 
monotonically with eccentricity, in agreement with the dependency on eccentricity 
of the psychophysical channels. 

In the field of computer vision, Rosenfeld was one of the first to propose explicitly 
an edge detection scheme-based on multiscale analysis performed with filters of 
difl^erent sizes (Rosenfeld and Thurston, 1971). A similar algorithm was suggested 
by Marr (1976) though with ditferent goals and motivations. More recently, he 
has strongly advocated the use of derivatives of gaussian-shaped filters of different 
sizes with the goal of detecting changes in intensity at different scales (Marr, 1982). 
The idea was first proposed in the context of a theory of stereornatching (Marr 
and Poggio, 1979). In that scheme, analysis at the difierent scales was effectively 
kept separate. Later. Marr and Miklreth (1980) proposed some heuristical rules to 



combine information from the different cliannels. However, the important problem 
of how to combine efiectively the different scales of analysis at thisn early level has 
remained open , although recent work by D. 'ierzopoiilos (1982) has successfully 
applied multi-level algorithms to the problem of reconstructing visual surfaces (see 
also the work by Richards et al, 1982 and by Canny, 1983 on edge detection). In 
a recent conference (Cold Spring Harbour, April 1983) we learned Irom A. Witkin 
a new way of describing zero- crossings across scale.^ 

A 1-dimensional signal is smoothed by convolution with a small (large) gaussian 
filter and the zeros of the second derivative are localized and followed as the 
size of the filter increases (decreases). Tliis procedure originates a plot of the 
zero contours in the x — o plane (where o measures the size of the gaussian 
filter).^ In this way, Witkin was able to classify and label zero-crossings achieving 
an effective description of a signal for purposes of recognition and registration. 
This is possible mainly because the geometry of the zero contours is surprisingly 
simple. Zero-contours are either lines from small to very large scale or closed, 
bowl-like shapes. Zero-crossings are never created as the scale increases. Witkin 
mentioned the striking result (obtained by .1. Babaud) that the gaussian filter is 
the only filter with this remarkable property in 1-D (at the same conference J. 
Koenderink told us that he has obtained similar results exploiting properties of 
the diffusion equation).^ 

We have now succeded in obtaining a proof of this result in 2D (and in fact 
any number of dimensions). We have also obtained related results for zero- and 
level-crossings of other dilTerendal operators, in particular for ridges and ravines 
in the image intensity. 

The 2-D result seems important because it: 

(a) lays the necessaiy mathematical foundation for using multi resolution labels for 
classifying zero-crossings for a symbolic description of intensity changes. 

(b) justifies the use of gaussian filters and an associated linear derivative becatise 
of their "nice" properties under changes in scale. 

In this paper, we will first state and prove the one-dimensional result. W^e will then 
show that only a specific 2-D extension is vahd. Zero-crossing of linear derivatives 
have the "nice scaling behaviour" if and only if the image is filtered by a 2-D 
rotationally symmetric gaussian. in particular, the laplacian-of- a-gaussian filter 
suggested by Marr and Hildrcth has nice scaling behaviour, llie second directional 
derivative along the gradient, however, does not: no filter exists that can ensure a 
nice scaling behaviour of the zeros of this derivative. We have then, the following 
results: 

' Wilkin's prize-winning paper will appear in liic 1983 IJCAl Proceedings (Witkin, 1983). We 
received a preprint after lliis memo went to press. 

2 J. Sumsfield first described ~ for analysing commodities trends (Stansficld, 1980) — tlie idea of 
plotting zero-crossings over scale, but did not develop it. 

■^ After completion of this memo we were informed that a technical report containing the ID proof 
is now ready, with the title "Uniqueness of the gaussian kernel for scale-space filtering," by J. 
Babaud, A. Witkin and R. Duda, Fairchild I R 645, Flair 22). 



(a) for linear derivative operalio.s- in pariicular, lor the laplacian-lhe gaussian 
is the only filter with a nice scalnig beiiaviour. 

(b) for the nonlinear directional derivative, no filter ^^'lll give nice scaling behav.ottr. 

2. AssuHiptions and results 

we vv'ill consider filtering the image / with a suit.jble ^^'f-'^^^d'hen consider 
the behaviotir of the zero crossings as we change the scale of the fille . We make 
fi{!e assumptions about the filter, and impose them as boundary condtuons. 
(1) Filtering is shift-invariant and, hence, a convolution. We write this as 

F */(£) = /f{£-1)%KC- 

,2) The fiher has no preferred scale length. In two dimensions ^t^^dard ^^^jj^ 
of dimensional analysis (Bridgman, 1922) give F{x,a) = ^./(s), whtie a is the 
ile of the filler. The factor i- ensures that the filter is properly nomial.zed at 
nil Qcnjcs 

(3) Tlie filter recovers the whole image at sufficiently small scales lliis is expressed 
by U,n„..,,F{..a) = i(.). where 6(x) denotes the Dirac delta function. 

(4) The position of the centre of llie filter is independent of c. Otherwise, zero 
crossings of a step edge would change their position with change of scale. 

(5) The filter goes to zero as |a:| h-> oo and as <7 1-> oo. 

-\s will become apparent, our results are independent of scaling the x axis. We 
usu-d rVqu le Iha we s ale this axis so that the filter is radially symmetric, and 
smie theorems with respect to such axes. However, we can relax this requirement 
by rescaling the axes. 
Hidure (\) shows the typical scaling behaviour of zero crossings in one dimension 

tel^ed I WKin. Figure (2) shows possible behaviour o^ -- ci.ssings v..^ 
is never empirically observed when the filler is a Gaussian. Hie gcnaic properties 
ofiie zerT OS ii gs curves in the x.a plane can be derived from Ihe Implicit 
Func ic^ nieo^^ To yield a C curve the theorem requires that the Laplacian of 
tl e r itered n^ge is C. therefore the filter must be reasonably smooth. Observe 

J^t fi tin ith a gaussian will ensure a C- output for all images because o 

he eau v ilence with the Cauchv problem for the diffusion equation, [he Imphc. 
Jui^n theorem may break "down at ^^^Bcnerateeritiail points when aO^^^ 
derivatives of the filtered image vanish together with the H^''^'""' ' ^^^-^'^^^ 
a e non-generic in the sense that a small perturbation wd! destroy t'^^^;^^ O'^ "^^ 

L "true" zero-crossings can onlv disappear in pairs in the x, a plant|^ Only trivial 
; 1 t do 1 rosstero can disappear by themselves. They are, however, non 



generic. 

In one-dimension, Ifie zero crossings obey 

'"^Zcmis^cif-'ilK Hessian correspond lo zeros of the gaussian curvature. 




Figure 1 See text. 
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Figure 2 See text. 



0= r /"(^^^-)%)rff. 



Tliis equation gives x as an implicit function of cr, i.e., x 
o so that (2.1) is still satisfied, we obtain 



(2.1) 
= x[o). If we vary x and 



dx 
da 



rcx>r(--^->(c)rfc 



(2.2) 



So the tangent to the curve is uniquely defined at a point, as are all the higher 

order derivatives. ^Fhis prevents tlie behaviour shown in Figures 2b, 2c with the 

possible exception of the nongeneric cases, when the Implicit Function Theorem 

breaks down. 

^fhe curve in Figure 2(a) is more interesting because it corresponds to a pair 

of zero crossings being "created" as the scale increases. The Implicit Function 

Theorem doe$ not rule out this case. It therefore seems natural to require a filter 

such that this never occurs. In the following three sections, we will prove some 

theorems sho\iving that such a filter can only be a gaussian and, moreover, that not 

all differential zero-crossings operators can obey this property. More precisely, we 

prove: 

Theorem 1. \t one-dimension, with the second derivative, the gaussian is the only 

filter-obeying our five boundary conditions— which never creates zero crossings 

as the scale ii^creases. 

Theorem 2. in two-dimensions, with the laplacian operator, the gaussian is the 

only filter obeying the boundary conditions which never create zero crossings as 

the scale increases. 

Theorem 8. Ih two-dimensions, with the directional derivative along the gradient, 

there is no filter obeying the boundary conditions which never creates zero crossmg 

as the scale i:[icreases. 

In section (5) we show that results similar to Theorems 1 and 2 can be extended to 

all linear differential operators (in particular, directional derivatives) and therefore 

to other featiares of the image, such as ravines and ridges (but not peaks) in the 

image intensity. ITiese theorems can be extended to any dmiension, but we will 

not give these extensions here. 

It should be emphasized that, although zero crossings can only annihilate themselves 

in pairs the: intensity change corresponding to a zero crossing could become 

arbitrarily sijialler as sigma increases. The zero crossing would then become so 

weak that fcif- practical purposes the curve may tenninate. 

3. The 1-D case 



Let the \m^ 
filtered ima 



e be / and the filter be F. We consider the zero crossings in the 



ge. 



Denote -^iF i 



/oo 
.F(a:-C)%K (3-1) 

-00 

I) by E. Hence the zero crossings are the solutions of 



E(x) = 0. 



(3.2) 



Tliese form citves in the a: — o- plane. The condition that zero crossings are not 
created at larger scales is that for all such curves (7{x) the extrema of (t{x) are not 
minima. Hence, for all points Xo such that a'(xo) = 0, we require that a"{xo) < 0. 

Let t be a parameter along a curve in a — x space. Then 



)i 



On a curve o 
choose the pai[|amete 
obtain: 



zero crossings, E = 0, and so ^ == on such a curve. We can 
r t to be X. Then, using the Implicit Function Theorem, we 



da — Ex 
dx Ea 

This result vaiishes at Xo if and only if 



and we calcul^ite 



then 



The Diffusion! 



dE _ dEdx dEda 
dt dx dt da dt 



(3.3) 



(3.4) 



Ex(xo) = 0, 



d'^a{xo) __ —Exxjxo) 



(3.5) 



dx'^ 



Eo(Xo) 



(3.6) 



Tlius, our filter must be such that if 



E(xo) =-- Ex(xo) = 



(3.7) 



Ea(Xo) 

Equation can be written as 



>0. 



(3.8) 



d^E _ 1 o^E 
dx^ a da 



(3.9) 



Note that by t 
Jfthe filter F i 



e substittition t = ^2"' ^^ obtain the standard diffiision equation. 
> a gaussian. 



then it will 
hence E{x) wi 
will always sa 

We now show 
obeys the 

Consider an 



obey 



tify 



the diffusion equation of which it is the Green function and 
also obey the equation. Thus, f f = J and so a gaussian filter 
conditions (3.7) and (3.8). 
that the gaussian is the only filter which satisfies the conditions and 
boufdary conditions specified in section (1). 
ige which is the sum of delta functions: 



mm 



It is possible t|) generate any image in this way by taking the limit as n >-► cx5. 
Set 



Equations (3.7) and (3.8) yield 



and 



F(x)=-^exp{-^}, 



(3.10) 



m = E A«{? - f.)- 



(3.11) 



»=l 



T{x) = Fxx(x). 



(3.12) 



E AiT(x, - fi) = 






(3.13) 



(3.14) 






>0. 



(3.15) 



We can constuct a counter example if we can solve the simultaneous equations 
for any Xo,Ci. -Cn and any positive t'^: 



X: AT{xo - ^z) - 0. 



X; AUXo - ^^) - 0. 
1=1 



(3.16) 



(3.17) 



We can write these as a matrix equation: 



Using Aplpendjx 
to solve tjhese 

X = (Xi,X2,X3 



and 



. (1) a necessaiy and sufficient condition for it to be impossible 
equations for any values of a:o,Ci.-.Cn is that there exists a vector 
X4) independent of x such that 



Our boundary 
any scale lengt. 
correct (Bridgjp 



and rewrite it 



Condition (3. 



Now T - ^i 

to F where 
(5) as 1 1-+ 00 



E ^^Txx(Xo - ^t) =-- -^' 

J2 ATa{Xo - ^z) = 1- 
1=1 



(3.18) 



(3.19) 



Equation (3.22 1 will be satisfied for all positive i^ if and only if 



dz 



( T(xo - ^1) 

T:,{Xo — ^1) 

ixiV'^o Slj 

\Ta{Xo — ^l) 



T{Xo - Cn) VAA 



I \ 



V 1 ) 



(3.20) 



\^T[X) -f \2T:,[X) + \zTUx) + >^4Ta(x) = 



.\^e + X4 7^ 



X3X4 < 



(3.21) 



(3.22) 



(3.23) 



condition (2) means that F[x), and hence T(x), cannot depend on 
1. The X's are independent of x and so to make (3.21) dimensionally 
an, 1922) we set 



Xi - 



Xo. = 



O' 



o 



X3 = c, X4 = 



(3.24) 



as 



— - -\ \- Clxx — ~~J^cr 

2 ' /T (7 



(3.25) 



(7 



a 



3) implies that ^ is positive, 

so F will also satisfy (3.25) although it is possible to add a term 
I ^. 0. However, this term will not satisfy the boundary condition 
and so we discard it. 



Ill us, we have 
filler F obeys 



shown that we can always construct a counter example unless our 
the equation 



with ^ positiv^. 
obeying the 



it is shown in Appendix (2) that the only solution of this equation 
bJundary conditions is the gaussian. Hence we obtain Theorem (1). 



We now fonslpei 
laplacian ;V^ 
image 



jer the two-dimensional case when the zero crossing operator is the 
d the image depends on x =- {x,y). Again, we consider the filtered 



ai 



We set 



The zero crdpm 
dimensiqnal { 
larger scales 
maxima br 
and tliert is 



we cannot heive 



Let t be a pi 



-^ + ^ F. + cF.. = ^F. 



(3.26) 



a' 



4. Tlie 2-D Case 



/oo roo 
/ F{x-^)I(x)di 
-oo J — oo ~ 



E(x)=: V2{F*/(x)} 



(4.1) 



(4.2) 



„....gs are solutions of E{x) = and form surfaces in the three- 

X a) space. Our requirements that zero crossings are not created at 

is' satisfied if the extrema of these zero crossing surfaces are either 

r saldle points. Minima are forbidden. Thus, if we have a surface (T(x,y) 

point [xo, Vo) with 



(^x[^o, Vo) = (^yi^o, Vo) = 



a^y = and both 



(^xx > Oj <^yy > 0- 
-ameter of a curve of the surface E{x) = 0. ITien, 

dE __dEdx dEdiy dEda 
"dt ~ 'dx dt dy dt da dt 



(4.3) 



(4.4) 



Since we ard on the zero crossing surface, we have f^ = and setting t 
then t ^ y, we obtain 



a^ =■- 



-Ex 

Ea 



(4.5) 
X and 

(4.6) 



Suppose ^ve q 
coincide With 



aiid 



It shoulc. 

curvature 

As in the 
if E obt^y 

positive^ 

a gaussii^n 

We no\^^ 
Ilie arg^ 



be 

on 
(th 

l-D 

s 

(4.8) 



i> 



tl e 



fiU^r 



shov\ 
men 



Set 



We cam 

^0} Cl- • 'J 



cons r 
<n an 



Using Appei 
for all aio,a, 



0". 



z5 



(4.7) 



e at an extremum {xo,yol Choose the x and y axes so that they 
he directions of principal curvature at (xo,yo). Then we calculate 



0^xx\'^0) Vo) 



^ygy-^oj Vo) — 



l^xxy^oVo) 
Ea(Xo,yo) 

^yy\^0} yo) 
Ea{Xo,yo) 



(4.8) 



(4.9) 



emphasized that (4.8) and (4.9) are true only at an extremum of 
ly if the x and y axes are taken along the directions of the lines of 

ensures a^y = 0). 

case, it follows that the conditions (3) and (4) will always be satisfied 
e Diffusion Equation. Since if (Jxx{^o,yo) and cryy{xo,yo) are both 
and (4.9) imply that ff^ and §^§~^ are both negative. Thus, 

will always obey our condition, 
that if the filter is not a gaussian, we can construct a counter-example. 

is a generalization of tlie proof of Theorem 1. Let 



1=1 



T{x) = V^F(x) 



(4.10) 



(4.11) 



ruct a counter-example if we can solve tlie matrix equation for any 
d any positive i-l and il : 



f T{xo - ^i) 
Tx[xo - a) 

Ty[Xo - ^l) 

Txx(3:o - ^i) 

'Tyy{Xo - Cl) 

V 2^^(3:0 — ^1) 



T(a:o-~Cn) \ 

J-x\^o fnj 

^ Vv^o Snj 

-iyxx\^o SnJ 

J-yy\^o Vn j 



(M\ 



\aJ 



/ \ 



V 1 } 



(4.12) 



dix (1), a necessary and sufficient condition for no solution to exist 
. ., ^„ is that we can find X = (Xi, . . ., X5) such that 



MA f ^2T.(x) + X3T,(x) + X4T,,(x) + X5T,, -I- \^Ta[x) = (4.13) 



10 



and 



Equatioiti 



Againi, ^j 



and f sfei isfie i 



with ci^E 



F will ^f: 
of bdu4fl 

It is sl^ 

condjti 

additSoi 



>qi 

tisfy 

Idary 



have 
lowed 



gaus^ia^i 
and wi 
filters: ji 
with pOp||tive 
upside- 
Sectibni 

SUgg^St^lfi 

of the 
smallei^ 



It IS 

crossing 
of 



(4.L 



und 11 




down 
of 
g 



^iirfa 



;ind 



,ii. F( 



^riieSe ^rrespon 
and tr(tii|ghs 



-£2X4-^^X5 + X6 7^0 (4.14) 

) can be satisfied for all positive ll and i] if and only if: 



X4X5 > 0, X4X6 < 0. 
ry condition (2) implies the X's are of form 



,X, 



— ,X3 

a 



62 



, X4 = ci, X5 = C2, Xe = 



a 



(4.15) 



(4.16) 



oT 



a 



o 



+ -Tx -f- -Ty + ciTxx + ciTyy = -% 



(4.17) 



0, which we can discard because 



and c\d > 0. 

(4.17) up to a term V with VV 
;ondition (5). 

Appendix (2) that the only solution of (4.17) which obeys our 

the product of two one-dimensional gaussians. If we make the 

jumption of symmetry, we obtain a two-dimensional symmetric 

Hlnce, the gaussian is the only filter which Svitisfied our condition, 

proven Theorem 2. There is an additional property of gaussian 

zero-crossing surfaces in the x, y, o space cannot have saddle points 

mean curvature //. The result of this section forbids the existence of 

mountains (in the x, y, o plane) and also of upside-down volcanos. 

zero-crossings surfaces normal to the x,y plane may appear as 

lines of zero-crossings are created. In fact, because of saddle points 

c|, zeros can be traced continuously along the zero-crossing surface to 

! mailer scales. 



1 le 
thit 



5. Further results 



cW^r th|t the methods of proof we have developed do not only apply to zero 
r example, consider the one-dimensional case and look for solutions 



5J(^*^) 



(5.1) 



d to maxima and minima of the filtered signal which we call peaks 
If we set E = -^(F * /) and duplicate the arguments of section (2), 
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we find th 
peaks and | 

More geiiej 
with the dip 




will not be 
operator^ 

In partitui 

created py 

invoh'es 

increase?, 

extremum 

derivative^ 



||reat(|d if and only if the filter is gaussian. Zeros of all linear differential 

cm be encompassed by Theorem 1. 

.r ir two dimensions, surfaces obeying i{F * T) = can only be 
;■ non gaussian filter. Thus, ridges and ravines whose creation necessarily 

ct^atioi of zeros along some direction, can only be created, as the sea e 
oy a non-gaussian filter. The argument, however, does not apply to 
point ; (non degenerate critical points, such as peaks and pits, where all 
Vanifi simultaneously). 

6. Directional operator 



We have 
directiqn^ 



pn 
deri 



The direcitional 



using th^ 
along th<| 



where 4 



The zjercfi 
that if vf^ 



a\in 



usioi I 



sii ered the two-dimensional case when our operator is the second 
ative along the direction of the gradient in the filtered image. Let 



ig a gaussian filter is a necessary and sufiicient condition for 
not to be created. 

L(x) is a difi"erential operator in any dimension that commutes 
equation, then solutions of 



^F * /) = const 



(5.2) 



H{x) = l JF{x-i)I{i)di. 



(6.1) 



is 










d 


1 dH 


d 




dt "" 


dH dXi 


dxj 



sumilation 
israd 



(6.2) 



convention on tlie j indices. The second directional derivative 
ent is then 



dt^ ~ HkHk 



(6.3) 



d: 



I H = -^i^ and we use the summation convention. We set 

E(x) - H,{x)H,{x)lMx) (6-4) 



cros ;mgs 
havi 



lie on the surface a(x,y), where E(x) - 0. Our condition is 
a point (a;o,yo) where 



(^x{^o,yo) = o-i;(xo,yo) = 



(6.5) 
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and tl^e 
surfact 



^i 



We use |he In plicit Function Theorem to obtain 



and wie cjilcul; 



we find 



where 
We dt^fiM 



and writ! J 



and 
that 



!/ axes are along the direction of the lines of curvature of the a(x, y) 
point, then it is impossible for both a^x and ayy to be negative, i.e., 



(^Xx{Xo,yo) < 0, (Tyy(Xo,yo) < 



(6.6) 



■E, 



Er 



■Er 



a,, = 



K 



(6.7) 



(6.8) 



,te 



f^xxy^Oi Vo) — 



(Jyy\XQ, ygj 



^xxy^Oi Vo) 
Ea{Xo,y) 

^yy\-^oj Vo) 

Eo[xo,yo) 



(6.9) 



(6.10) 



Again; ncte tf at if E obeys the Diffusion Equation, then the conditions (6.5) and 
(6.6) (^annot b^ satisfied. However, E is no longer a linear function of the filter, 
and sd) Mil caifiot direcdy obtain a condition the filter must satisfy. Now set 






(6.11) 



IhHjHij = AaA^A^F,(a)Fy(/?)F,y(7) 
\M sunlmation convention applies to a, (3, 7 as well as to i, j. 



(6.12) 



T{aM) = -{F,(a)F,(/^)F,,(7) + F,(/?)F •(a)F,,(7) 
+ F,(a)F,(7)F,,(/?) + F,(/?)F,(7)F,,(a) 
+ F,(7)F,(a)F,,(/?) + F,(7)F,(/?)F,,(a)} 



(6.13) 



(6.1 •) as 



H,HjH,j - T{aM)AaApA^ 



(6.14) 
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We cart i)rodu( e a counter-example if we can satisfy 



/ T(a/?7) 
Tx(a/37) 

T^y{oth) 



Itfollcjw 
such tpaj 



Xinaj/J-f) 



but 



Irom 



As m stt 
r(Q/?|y) 

Howevdj- 
that theiii 
Diffuibicn 
solutit)n 
of 



if and i i\y 



lies In 



+ 



X jTx(a/37) + ^3Ty(ap^) + X4r^x(«^7) 



since 

are 

Eq 



le sf 



... \ 


^AaAi3A^\ 




r \ 



. .. ; 


V . J 


= 



V 1 J 



(6.15) 



Appendix (2) that no solution exists if there is a X = (Xi, X2, X3, X4, X5, Xe) 



+ X5T^y(«/?7) + X6T4a/?7) = 

(6.16) 



-£?X4-^^5 4-X6 7^0. 



(6.17) 



tftionl (3), we can use dimensional arguments to show this means that 

Itisfils the generalized Diffusion Equation. 

. we require solutions to (6.15) of specific fonn AaA^A^ it is possible 
no solutions of (6.15) even if T(api) does not obey the generalized 
ation. To rule this out, we must show that it is possible to find a 

tt)f folm AaApA^. From Appendix (2) it is possible to get a solution Ba/3^ 



/r(a/?7)\ 



(Bap^^ 



the vector 



\Ta{0LplV\ • J 



( \ 




^2 
V 1 ) 



/ \ 



V 1 ) 



(6.18) 



aced spanned by the 
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as a,f^,^] 



by i' and 



by n^,, 

Each T 

n{n-\-i ){n 



lir.eaitly 



vary, 



one iolu 



where 
We liio 
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ifidej 
I th£ 



doe 
lion 



Denote 



fT{a,di)\ 



\Ta(af3^)) 



r \ 




V 1 J 



( "^OlM \ 



\Ta[aMV 



whe *e I = 1 to 6. 



is symmetric in all indices a,/? and 7 and so there are N = 

silch vectors. Tliey have only six components each and so they are not 

endent There will be at least N - 6 linearly independent vectors 






(6.19) 



not obey the generalized Diffusion Equation there will be at least 
5a^^ to (6.18). The general solution is of form 



iV-6 



(6.20) 



is arbitrary, 
ask 



under what conditions can we find Aa and ^ which satisfy 

JV-6 

^a/37 + E ^p'^%1 == AaA^A^ 



(6.21) 
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th( 



pie, 
tl 



From 

exam 

lies ill 

necess 

vectors 

dimensi( 

Let tlie 
solve ^6. 



n 



for 
Hen 
: N 
and 
hich 
1 lal s 



ve \ectors be PaM^QaP'^,TaM^^cch ^"^^ ^«/37- ^^ will be possible to 
(I) ai d hence (6.15) if we can satisfy 



These ai^ 
n SLlfltici 



iMtly 



Thus, u 
possilt>le 



less r(a/?7) obeys the generalized Diifusion Equation, it will always be 
[o cc nstruct a counter-example. 



We r^ovi 
First suiUDose 



as^ 



shov 



where m 
Then w| 



fine 



Gij\[o\ 



So w^ (> )tain 



of (6.15) it is clear that scaling the A's will not affect the counter- 
:e, satisfying (6.21) is equivalent to finding an Aa such that AaA^A^ 
5 dimensional vector space spanned by Baf3^,^l^p^,...,^^^^. A 
sufficient condition is that AaApAy is perpendicular to the five 
span the complement of this N-5 dimensional space in the full N 
ace. 



Paj3^AaApA^ = 
Q aP^-^aAisA^ = 
TaP^AaAjjArj — 0. 

Yap^AaApA.^ = 0. 



(6.22) 



stem of five simultaneous cubic equations in n variables. If we take 
arge, it will always be possible to solve them (Yuille, in preparation). 



that no reasonable filter will satisfy these requirements, 
we have a gaussian filter G(x, a) 



2 X' 



20-2 



(6.23) 



is a \ arbitrary number. 



Gi{oc) = z^^TTo ^^Pi WTo 1 



cr 



m+2 



2a' 



(6.24) 



hj 



fjn-j-2 



exp{- 



(i-k)\ , (£ - £a)i(s " fe),- , (S--U 



2o' 



} + 



a 



m-{-4 



exp{- 



iG' 



} (6.25) 
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TiaM) =-- 



As showr in . 



If we sul istiti te (6.26) into (6.27) we see that ciT,, + c2Tyy contains a term 



All othdlt tents 
C^and 



tc» 



fovZ 

Now suiposi 

and integrate 



// 



Hence, 



wi 



This 
equatic 

genera 



We ha\e 



2ex 
X 



■( 



o3 



+ 






+ 



C— C^)^(^— £«) 



appendix (2), the general Diffusion Equation can be written 



A{x 



vith 



be 



stil 

I foi 

iied 



(^ „ y 2 (x - ^jf [x - ^jf 



] 



2ct2 2a2 2<72 

1 (_.(:r - f„) . {£ - f;3) - (x - f;,) • (x - £,) - (S - £,) • (S - y 



O' 






(6.26) 



d 



-r. + ^T, + ClT,, + C^Tyy = -Z 



(6.27) 



exp{- 



{--iJ (^-^/ (^-^.^' 



2^2 



} 



(6.28) 



'-^3^^^W^^^P^ 2(72 2(72 

in (6.27) will be of this form multiplied by powers of{x — Q,(x 



: ). From (6.17), ci and C2 have the same sign and so it is impossible 
2 Tro and, hence, (6.27) cannot be satisfied if the filter is a gaussian. 
we have a filter which satisfies this requirement. Set ^^ = £^ + i^ 
T[a(5-i) with respect to £„ and c^. We find 



t, = £a + ir ^'^ ^^^^ 

/ / T{a(3^)diji^ = Fi * Fj * Fi,(3^) (6.30) 

satisfy the generalized Diffusion Equation since T[aM) obeys this 
ill values of £^,£^ and Cy From Appendix (2), the solution to the 
iffusion Equation is P *7(i), where / is an arbitrary function and 

(6.31) 



D 



1 r (^ + h(^) d. r (y + h(^? d 
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The boun iary 
y axes to Inak 



Fi * Fj * F^j{3x) = G * f(x) (6.33) 

Fouilifcr titnsform this equation denoting the fourier transform of a function 



We 

g{x) by 1 



But we liLve 



and 



Hence, 



and 



i; 



Tlius F 

Equatioi 

boundary 

So a filtc 
a gaussiifl 
it is m 
does hot 
apprdxi 
in th0 
zero 

are s^tisf 
influence 



I ) 



9{^) 



the 
Bl 



cai 
ssib 
than iQ 
liated 



of 



Fi * Fj * F^J{3x) - P * f(x) 



(6.32) 



condition (4) means that bi=-b2 =0 and we can scale the x and 
P a gaussian. Thus 



TF^{ui)rFj{ui)TF,j(ui) = rG{3uj_)Tf{3ui) 



TFi{ui) = -iuJiTF{ui) 



n 

TG(3y) = exp{=?^} 



Qf.2 

uj'{TF{ui)}' = exp{-^}Tf{3u) 



(6.34) 



(6.35) 



(6.36) 



(6.37) 



TF{ui) 



(^^}*e.p{=-¥} 



OJ 



2cr2 



(6.38) 



convolution of a function with a gaussian and obeys the Diffusion 
, as shown in Appendix 2, the only such filter which satisfies the 
conpitions is a gaussian. 

whth obeys the conditions (6.16) and (6.17) must be a gaussian, and yet 

not satisfy these conditions. Therefore, for this directional operator, 

e to satisfy our requirement. Notice that if the gradient direction 

rapidly the second directional derivative along the gradient can be 

by the second derivative along the x axis, where the x axis is chosen 

dlbctiln of the gradient. 'The arguments of section 5 then show that no 

are created if, and only if, the filter is gaussian. If these assumptions 

sHed It one scale, they may break down at larger scales because of the 

ither parts of the image. We therefore expect that at large scales 
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zero-c|'os 
simpl^ (f 



^ings may be created even for gaussian filters, unless the image is very 
|r instance an isolated straight step-edge). 

7. Conclusions 



:ne 



The behHlvior 
than in 
into (^ne 
a one-dithens 
one-qimBinsio 
a 



tr ink 



cros nng 



occur: 

as the 

of thi ztro-cipssm 

of a ^ero 

whicft ij 

corre^pqjfdinj 

two-cji 

exarat)ld; 



irarnsio 



In sum 
nice sea 
Notice 
obtain e 
presen 
reprp 



reser 



repr| 
to be 



psa t 



3f the zero- (or level-) crossings is more complex in two dimensions 

( imension. In the 2-D case, two zero crossing contours can merge 

closed contour as the scale increases. The zero-crossing surface has 

onal crossection (for given y, say) that corresponds to an allowed 

al case. In 2-D, however, the "complementary" situation can also 

tloseti zero-crossing contour can split into two as the scale increases, just 

|f a tree may spht into two branches. This occurs at saddle points 

g surface. This case would correspond in 1-D to the "creation" 

(imagine a one- dimensional section of the zero-crossing surface) 

forbidden. In 2-D, however, no new zero crossing is created, since the 

surface is continuous down to zero scale. We have constructed 

lal examples of both these two cases, using the gaussian filters. Both 

Id also work for all other filters. 



It is interesting 
linear ec 
of its si 



uati )n 



ifliary. 

ingl 

hat 

by 

sti 



wo 



Several (|thei| functions have been proposed for filtering images. We expect that 
they on ' giv i a nice scaling behavior for values of a for which they approximate 
the sqiut on ( f the diffusion equation. The DOG (difference of gaussians) does not 
satisfy tt e di fusion equation, but is a good approximation except when a is very 
smalt :)ne-( imensional real Gabor functions (the product of a gaussian and a 
sine br ; cos; le) approximate the solution of the diffusion equation only for large 
values o' a. Our conditions are violated even more by the sine function which 
only sa:sfies the diffusion equation at best in a weak asymptotic sense. Figure 
3 shows an ( jcample of the zero-crossings generated by the gaussian and the sine 
filter 



that our proof implies that the difference equation is the only 
that has, with suitable boundary conditions, a nice scaling behavior 
utiolis. This may have some implications in physics. 



we have shown that the gaussian is the only filter that guarantees a 

ehavior of the zero- and level-crossings of linear differential operators. 

the gaussian need not be symmetric: elongated directional filters, 

stretching the axes, also have a nice scaling behaviour. We are 

tp|/ stildying the practical use of the scaling diagrams (in 2-D) for a symbolic 

tatic n of images, as suggested by Witkin, and, in particular, for solving the 

corrfesiilndajce problem in stereo. In this context, the robustness of the "scaling 

under small perturbations of the image is clearly critical and has 

carefully studied. 
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OUT res:! i*iin:0 na« 




OUT res; 1 ri n;0 ra?^: 1 



Figure 3 Examples of the zero-crossings of the secoi 
(a) and of the sine filter (b) for the same input functi 
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If we hiv\{ a n 



tlie nece!3s ary 



Hence a 
that we 



t in 



but that 



Supposes 



We can 
terms 



We wrili ; 



where 
(3) and 



lece 



i^mo 



atrix equation 

Bx = a 
nd sufficient condition for a solution is that 

6ti ... bin\ f^n ••• hn fli 
I =1 rank\ 

. Ovnin. ^t 



sary and sufficient condition for the non-existence of a solution is 
fi id a vector X = (Xi, . . ., X^), such that 



we 1 



UJ, 

2) 



Appendix I 



(1) 



rankl 



.b. 



ml 



hn\ [hi 

, I :=! rankl . 

bmnJ V6ynl 



(2) 



'inn "'Tn' 



Xl(bll, . . ., bin) -f • • • + >^m{bml, • • •, bmn) = 
Xiai -{-••• + ^m(J"m 7^ 0- 

Appendix 2 

ave a generalized Diffusion Equation of form 

a _] \- cFxx = 



(3) 



(4) 



(1) 



the first term by the scaling F ^ a-^^/^^F. Consider the remaining 



bFx 



o 



-f-cF, 



dFn 



(2) 






'du 



(3) 



<7 

ve 



is the Fourier transform of F(x,a) with respect to x. Combining 
obtain 



b{—i(jj) 



a 



f + c{-uj')f = -: 



ddl 
a da 



(4) 
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We inte 



where gl c) is li function of integration independent of o. 
Hence, |i|jbstiiiting (5) into (3) gives us 



Note 
is well 



that 



we 



re considering equations for which cjd is positive and so the integral 
defined. We now apply the convolution theorem to (6) and get 



where /i 

e ^ e 



Thus th^ 



We novj 
\{x,a) i 
filter 



A 



Write 



and con; 



where 6 
will ei 
Morevet 



ate 



(;■) is 



tlitr 



the fourier transforai of g{(jj) and \{x, a) is tlie fourier transform of 
1^. We calculate 



mip 

age 

no 



tider 



nd get 



iijjbo — cw t7^ 



f{w,cr) = g(u){e ■< e " ' } 



(5) 



F(x,<7) = / g{oj){e ^ e <* ^ }< 



, — tOJX 



du 



(6) 



F(x, a) = / \(x — <:, <T)/J(?)df 



(7) 



\{x,a) = 



dl 
c a 






(8) 



gem ral solution to (1) is of form 






(9) 



)se the boundary conditions stated in section (1). First, note that 
alissian with centre x — —ho. The requirement that the centre of tlie 
move implies that 6 = 0. 



F[x,a) = o-W 



d 1 -d 
c o 



-<)' 



/i(^)dC 



(10) 



he limit as a tends to 0. Now, 






(11) 



dene tes the Dirac delta function. If (^) is non-zero the limits of F(x,a) 
be undefined or zero. Hence our boundary condition (3) forces a = 0. 
sub tituting into (10) we obtain 
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and cor clitic n (3) means that fi(x) must be the delta function. Hence, on 
substiuit ng t lis back into (10) the only solutions of (1) which satisfies our boundary 
conditio is he gaussian 



111 is aiiulysi 
Equation 



A simi 
in a 



tW[3 



m ar^ ument shows that the only solution obeying the boundary condition 
■dim i^nsional space is 



We use 



We cari 



and 



respect] \ely 



Jie 5 



scale 



Lima^^oF{x, a) = ji{x) 



(12) 



G{x,a) = 



dl 



-e'^S 



(13) 



can be extended to the two dimensional generalized Diffusion 



aF hiF^ ^^^y d 

+ -^ -f H- ciF^x + C2Fyy = -Fa 



a 



a 



o 



(14) 



G(x,y,cr) 



1 \ d I d 1 -dx^ -dv^ 



(15) 



ymmetry requirement of section (1) to set ci ■■= ci. ITien we obtain 



^, ^ \ d \ -d(^^-fv^) 

G x,7y,cr = ^e^^ o^ 

27r c o^ 

the (7-axis by J\ and write (13) and (16) as 

1 1 z::^2 

G[X,U) — 6 2"'^ 

' (J 



(16) 



(17) 



This ensures that a is the standard deviation of the function. 



(18) 
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